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SPECIFICATION 

ELECTRONIC INFORMATION CONTENT DISTRIBUTION 
PROCESSING SYSTEM, INFORMATION DISTRIBUTION 
APPARATUS, INFORMATION PROCESSING APPARATUS, 
AND ELECTRONIC INFORMATION CONTENT DISTRIBUTION 

PROCESSING METHOD 

BACKGROUND OF THE INVENTION 
FIELD OF THE INVENTION 

The present invention relates to an electronic 
information content distribution processing system, an 
information distribution apparatus, an information 
processing apparatus, and an electronic information content 
distribution processing method suitable to interactively 
operating advertisement contents distributed by broadcasting 
or communication, and applying such contents to new 
electronic advertisement media such that a user can enjoy like 
a game. 

DESCRIPTION OF T HE RELATED ART 

Conventionally, according to an advertisement system 
represented by big four mass media such as television, radio, 
newspaper and journal, a sender supply the contents of 
advertisement to a receiver one-sidedly. Its advertisement 



affect is limited to announcement and recognition level of new 
target products. For a receiver, it is a main object to hear 
and read a main body of contents, and it is a basic style to 
attendantly hear or read company products advertisements 
supplied at add moments, resulting in recognition and 
understanding of an advertisement target. 

Therefore, in the case where an attempt is made to 
obtain further detailed information on products recognized by 
this advertisement system, consumers arrange a 
manufacturer for documents, see actual materials at a store at 
which such products are present, and search the same 
product information using another information media again. 
For example, according to an advertisement system caused by 
paper media such as newspaper or journal, comparatively 
detailed product information can be obtained. Product 
information is only read and seen as advertisement 
information obtained from such product information. 

In addition, according to an advertisement system 
caused by broadcasting electronics media using television or 
radio that is one of a high efficiency advertisement system, 
advertisements are inserted spot-likely between frames of 
providing programs with high visibility or high interest or a 
programs (hereinafter, referred to as spot advertisement), 
thereby making it possible to ensure that many more 
consumers recognize product information at home. 
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On the other hand, technical advancement of 
computer graphics is remarkable, and its high-level 
expression and compacted, lower-priced reproduction 
apparatus are also significant. In addition, with the spread 
of personal computers, a banner advertisement system by 
internet is used, According to this banner advertisement, 
concerning an advertisement interested by a consumer further 
new related home pages can be opened by mouse clicking 
operation and the search can be easily made by mouse 
operation. 

In the meantime, such advertisement system has the 
following problems. 

<1> According to broadcasting electronic media using 
television or radio and the like, information is transmitted 
one-sidedly from an advertiser to a receiver; an advertisement 
is displayed; and audio is output in real time. Thus, there 
are often cases in which advertisement information is far away 
before consumers concentrate their consciousness on such 
advertisement. In the case where an attempt is made to refer 
to that advertisement again, advertisement information must 
be recorded in a recording medium such as a home server in a 
video tool such as video tape recorded (VTR) or home server. 

However, the advertisement system using a recording 
medium of such type for recording as well is limited to 
announcement or recognition of new products or company's 
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idea. As in the advertisement system using paper media 
such as newspaper or journal, the system is limited to reading 
or seeing level. If a receiver attempts to more deeply 
understand such new product or company's idea, an 
additional action such as another medium supervision or 
actual use experience at a store etc. is required. 

<2> According to such broadcasting electronic media, 
a main object of the receiver is to obtain the broadcasting 
program contents (content main body) directly irrelevant to 
the advertisement contents. Thus, the receiver feels 
resistance when an advertisement irrelevant to the content 
main body often appears. In addition, when a program is 
switched to CM, a so called zapping action for switching a 
channel to another is performed. Thus, there are often cases 
in which an advertisement effect cannot be obtained for the 
advertiser's desire. If a advertisement is reduced according 
to the receiver's quantity, the program cost is reduced. Thus, a 
"negative spiral" that the quality of content main body itself is 
lowered. 

<3> In addition, according to an advertisement system 
using Internet, a telephone line is corrected during 
information search. Thus, the communication charge is 
increased, and certain time intervals are required for 
information search. Moreover, the advertisement 
information obtained via Internet as well, corresponds to a 



visual / audio level such as reading and seeing, as in the 
advertisement system of paper media such as newspaper or 
journal. In order to obtain detailed advertisement 
information, the corresponding product must be actually seen. 

SUMMARY OF THE INVENTION 

The present invention has been made to solve such 
problems. It is an object of the present invention to provide 
an electronic information content distribution processing 
system, an information distribution apparatus, an 
information processing apparatus, and an electronic 
information content distribution processing method, which 
reverse a concept of an advertisement which has been 
supplied one-sidedly, and which is capable of constructing 
electronic advertisement media for interactively performing an 
advertisement. 

The above mentioned problems are solved by a system 
of distributing electronic information contents containing an 
advertisement, and information processing electronic 
information contents at the user side, said system 
characterized by comprising: 

an information distribution apparatus for distributing 
said electronic information contents to a user; and 

a plurality of information processing apparatuses for 
receiving and storing the electronic information contents 



distributed from said information distribution apparatus, 
reading out said electronic information contents according to 
a user operation, and processing the electronic information 
contents, and then, outputting an advertisement video image 
and its audio. 

The electronic information content distribution 
processing system according to the present invention is 
characterized in that, in the case where electronic information 
contents containing an advertisement are distributed to a user, 
and the electronic information contents are information 
processed at the user side, for example, the electronic 
information contents are distributed from the information 
distribution device to the user information processing 
apparatus by using a specific channel for distributing only the 
electronic information contents concerning an advertisement. 
These electronic information contents contain video image 
element information and audio information concerning an 
advertisement whose information can be operated in a user; 
and program information for processing these items of 
processing. The electronic information contents distributed 
from this information distribution apparatus are received and 
stored by an information processing apparatus. Then, 
electronic information contents are read out according to a 
user operation, and the electronic information contents are 
processed by the information processing apparatus, and then, 



an advertisement video image and audio information are 
output. 

Therefore, after receipt of electronic information 
contents, the user can see an advertisement video image or 
hear audio information, the image and audio information 
freely processed with respect to an advertisement like playing 
a game in unreal time (asynchronously). In this manner, 
there can be constructed an electronic advertisement medium 
reversing the conventional concept of an advertisement 
caused by bit four mass media, the advertisement being 
supplied one-sidedly, and capable of interactively performing 
an advertisement, and a new advertisement mass medium 
following four mass-communication media can be created. 

Moreover, the user can operate an advertisement 
information medium freely and be enjoyable as compared with 
an advertisement which the user can only see and hear, the 
user's interest is increased, and an advertiser can implement 
an advertisement with its long life and high communication 
effect. 

The information distribution apparatus according the 
present invention is directed to an apparatus for distributing 
electronic information contents containing an advertisement, 
the apparatus comprising: a data inserter for constructing 
electronic information contents concerning an advertisement 
in a group of data, thereby inserting the contents into a 
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carrying signal; and a transmitter for transmitting the 
carrying signal obtained by constructing and inserting the 
data by this data inserter to a user information processing 
apparatus. 

The information distribution apparatus according to 
the present invention is featured in that, in the case where 
electronic information contents containing an advertisement 
are distributed to a user by using an existing broadcasting 
infrastructure, for example, electronic information contents 
concerning an advertisement are constructed in a group of 
data, and is inserted into a carrying signal by means of a data 
inserter. The electronic information contents are provided so 
as to be transmitted by being multiplexed in a vertical 
blanking period of a television broadcast signal (carrying 
signal). A television broadcast signal obtained by 
constructing and inserting the data by this data inserter is 
transmitted simultaneously from the transmiter to a user's 
information processing apparatus. 

Therefore, in the user's information processing 
apparatus, a group of data is received within a predetermined 
period, and can be stored in a storage device in batch. In this 
manner, after receipt of the electronic information contents, 
the user can see an advertisement video image and hear audio 
information, the image and information freely processed with 
respect to an advertisement by means of the information 
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processing apparatus in unreal time (asynchronously). 

The information processing apparatus according to 
the present invention is directed to an apparatus for 
information processing electronic information contents 
containing an advertisement, wherein electronic information 
contents are received and stored, electronic information 
contents are read out according to the user operation, and the 
electronic information contents are processed, and then, 
outputting an advertisement video image and audio 
information. 

In the information processing apparatus according to 
the present invention, in the case where electronic 
information contents containing an advertisement are 
information processed, for example, upon receipt of the 
electronic information contents distributed using a specific 
channel that distributes only electronic information contents 
concerning an advertisement, the electronic information 
contents are temporarily stored in a non-volatile storage 
device or the like. Then, the electronic information contents 
are read out asynchronously of a receiving operation 
according to the user operation, and the electronic 
information contents are arbitrarily information processed. 
For example, the video image element information and audio 
information concerning an advertisement are arbitrarily 
processed by program information according to the user's 



information operation. The advertisement video image and 
audio information after thus processed are output. 

Therefore, after receipt of electronic information 
contents, the user can see an advertisement video image or 
hear audio information, the image and information freely 
processed with respect to an advertisement in unreal time 
(asynchronously) like playing a game. In this manner, new 
game media following an arcade game, home use game 
machine, hand held game machine or the like. New media in 
which an entertainment device and advertisement are fused 
can be created. 

An electronic information content distribution 
processing method according to the present invention is 
directed to a method for providing a user with electronic 
information contents containing an advertisement, and 
information processing electronic information contents at the 
user side, characterized in that electronic information 
contents are distributed to the user, the thus distributed 
electronic information contents are received and stored, the 
electronic information contents are read out according to the 
user operation, and an advertisement video image and audio 
information are reproduced based on the electronic 
information contents. 

In the electronic information content distribution 
processing method according to the present invention, the 
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user can operate electronic information contents like playing a 
game, and thus, it can be expected that electronic information 
contents concerning an advertisement is spread 
spontaneously in an increased number of users who like to 
play a game. This contributes to introduction into a demand 
for a new advertisement industry. 

BRIEF DESCRIPTION OF THE DRAWINGS 

For a better understanding of the present invention, 
reference is made to the following detailed description, just in 
conjunction with the accompanying drawings in which: 

FIG. 1 is a block diagram depicting an exemplary 
configuration of an electronic information content distribution 
processing system 10 embodied according to the present 
invention; 

FIG. 2 is a flow chart showing an example of 
processing in the electronic information content distribution 
processing system 10 embodied according to the present 
invention; 

FIG. 3 is a flow chart showing another example of 
processing in the electronic information content distribution 
processing system 10 embodied according to the present 
invention. 

FIG. 4 is a imaginary view showing an exemplary 
configuration of an interactive advertisement system 100 that 



is a first embodiment according to the present invention; 

FIG. 5 is a block diagram depicting an exemplary 
configuration of an information distribution apparatus 9 and 
its peripheral system embodied according to the present 
invention; 

FIG. 6 is an imaginary view showing an example of a 
format of a data. 

FIG. 7 Is an imaginary view showing an example of 
contents of the program information, video image element 
information, and audio information; 

FIG. 8 is a block diagram depicting an exemplary 
internal configuration of an entertainment device 101; 

FIG. 9 is an imaginary view showing an exemplary 
configuration of an interactive advertisement system 200 
according to a second embodiment of the present invention. 

FIG. 10 is a block diagram depicting an exemplary 
internal configuration of a tuner device 24 and a hand held 
terminal device 14; 

FIG. 11 is a flow chart showing an exemplary 
operation of the tuner device 24 in the interactive 
advertisement system 200; 

FIG. 12 is a flow chart showing an exemplary 
operation (main routine) of a hand held terminal device 14 in 
the interactive advertisement system 200. 

FIG. 13 is a flow chart showing an example of 



processing (subroutine) according to the advertisement video 
image processing; 

FIG. 14 is a block diagram depicting an exemplary 
internal configuration of a tuner device 24' and a hand held 
terminal device 14 used in an interactive advertisement 
system 300 that is a third embodiment according to the 
present invention; 

FIG. 15 is an imaginary view showing an example of 
configuration of an interactive advertisement system 400 that 
is a fourth embodiment according to the present invention; 

FIG. 16 is an imaginary view showing an example of a 
format of a data in an advertisement program specific channel; 

FIG. 17 is a block diagram depicting an exemplary 
internal configuration of a hand held terminal device 401; and 

FIG. 18 is a flow chart showing an exemplary 
operation of the hand held terminal device 401. 

DESCRIPTION OP THE PREFERRED EMBODIMENT 

Now, one embodiment of the electronic information 
content distribution processing system, information 
distribution apparatus, information processing apparatus, 
and electronic information content distribution processing 
method, will be described with reference to the accompanying 
drawings. 
(1) Embodiments 



FIG. 1 is a block diagram depicting an exemplary 
configuration of an electronic information content distribution 
processing system 10 embodied according to the present 
invention. 

In the present embodiment, this system comprises an 
information processing apparatus for information processing 
electronic information contents containing an advertisement, 
wherein electronic information contents that have been 
received and stored in advance are read out asynchronously 
according to a user information operation, and the electronic 
information contents are processed, and then, outputting an 
advertisement video image and audio information. In this 
manner, a concept of an advertisement, the advertisement 
having been supplied one-sidedly, is reversed, and electronic 
advertisement media that performs advertisement 
interactively can be constructed. Further, the user can 
operate electronic information contents concerning an 
advertisement freely and feels more enjoyable, the 
advertisement having been just seen or heard. 

The electronic information content distribution 
processing system 10 shown in FIG. 1 is a system that 
distributes electronic information contents containing an 
advertisement to a consumer (hereinafter, referred to user Hj, 
j = 1 to m), and information processes electronic information 
contents DO at the user side. The electronic information 
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contents DO relates to a data on broadcasting program and an 
advertisement. In this system 10, there is provided an 
advertisement specific channel for distributing only electronic 
information contents DO concerning an advertisement like 
playing a game. 

This is because electronic information contents DO 
concerning an advertisement that can be played free is 
provided to a prospect user Hj who likes to play a game. 
The electronic information contents DO contain video image 
element and audio information D22 concerning an 
advertisement whose information can be operated; a video 
image of these items of information D22; and program 
information D21 for audio processing. The electronic 
information contents DO are provided to be distributed to the 
user Hj by using a current broadcasting infrastructure or a 
communication infrastructure. 

In the case where a broadcasting infrastructure, for 
example, is used in the electronic information content 
distribution processing system 10, an information 
distribution apparatus 19 is provided at a broadcast station or 
the like, and the electronic information contents DO = D21 + 
D22 is distributed to the user. The information distribution 
apparatus 19 is provided to distribute electronic information 
contents DO concerning an advertisement through an 
advertisement specific channel that has been assigned in 
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advance. At this information distribution apparatus 19, at 
least a data inserter 92 and a transmitter 1 are provided. 

In the case where an advertisement specific channel is 
used, a plurality of electronic information contents DO 
concerning an advertisement are constructed in a group of 
data at the data inserter 92. In the case where the electronic 
information contents DO concerning an advertisement are 
mixed at the data broadcast program channel, broadcast 
information contents Dl concerning an arbitrary data 
broadcasting program and electronic information contents DO 
concerning an advertisement are constructed at the data 
inserter 92 in a group of data. The broadcast information 
contents Dl are composed of audio information Dll and video 
image information D12 concerning an arbitrary data 
broadcasting program (Dl = Dll + D12). 

A transmitter 1 is connected to this data inserter 92, 
and the data are multiplexed, for example, in a free space such 
as vertical blanking period of a television broadcast signal 
adopted by an existing broadcasting infrastructure, then 
transmitted to the information processing apparatus 8 of the 
user Hj. Namely, in the case where an advertisement specific 
channel is used, electronic information contents DO = D21 + 
D22 are transmitted. In the case where a data broadcasting 
program channel is used, electronic information contents DO + 
broadcast information contents Dl are transmitted. 



In this system 10, information processing 
apparatuses 8 are provided to a plurality of users Hj. The 
electronic information contents distributed from an 
information distribution apparatus 19 are received and stored, 
the electronic information contents are read out 
asynchronously according to a user operation, and the 
advertisement video image and audio information obtained 
after the electronic information contents have been arbitrarily 
processed are output. 

Namely, a receiver 2 is provided at an information 
processing apparatus 8, and a group of data (electronic 
information contents DO) transmitted from a transmitter 1 of 
the information distribution apparatus 19 is received. A 
control device 3 is connected to the receiver 2, and a non- 
volatile storage device (memory) 5 is connected to this control 
device 3. The electronic information contents DO received by 
the receiver 2 is stored (saved) in memory 5. Although the 
information processing apparatus 8 will be described in each 
embodiment, an entertainment device comprising a receiving 
function, a tuner device and hand held terminal device 
combined with the receiver 2 and memory 5, and a hand held 
telephone set comprising a tuner function are configured. 

A user interface 4 is connected to this control device 3. 
In this control device 3, electronic information contents DO are 
read out from a storage device 5 according to operation inputs 



passed through user interface 4, and electronic information 
contents DO are information processed so as to display and 
control an advertisement video image. For example, video 
image element and audio information D22 concerning an 
advertisement is arbitrarily video imaged and audio processed 
based on program information D21 read out from the memory 
5, Alternatively, a data broadcasting program is reproduced 
based on the broadcast information contents Dl. 

Items of operation inputs D3 and D4 concerning 
electronic information contents DO are provided as input 
through user interface 4 connected to this control device 3. 
They are intended to control input / output of the control 
device 3 and receiver 2. They are generated by free operation 
of operating unit such as controller, by the user Hj. The 
broadcast information contents Dl and electronic information 
contents DO concerning an advertisement are read out from 
the memory 5 based on this operation information D3. 

In addition, an interactive advertisement video image 
processed by the control device 3 based on operation input D4 
or a reproduced data broadcasting program is displayed on a 
monitor or the like (not shown). For example, in the case 
where a data broadcasting program channel is selected, the 
electronic information contents DO and broadcast information 
contents Dl are already downloaded on the memory 5. 
Before displaying the reproduced data broadcasting program, 
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a spot advertisement is displayed on the monitor based on 
video image element and audio information D22. In addition, 
when the data broadcasting program is ended, a spot 
advertisement based on these items of information D22 is 
displayed. 

Further, in this system 10, when a spot advertisement 
video image is displayed, a control program is executed such 
that the user can select whether or not to set a program 
reproduction mode or to set an interactive advertisement 
operating mode. Here, the program reproduction mode 
denotes an operation for reproducing broadcasting 
information contents Dl according to a data broadcasting 
program. The interactive advertisement operating mode 
denotes an operation for video imaging and audio processing 
the video image element and audio information D22 based on 
items of operation inputs D3 and D4 through the user 
interface 4 and program information D21. 

In the case where the interactive advertisement 
operating mode is selected, for example, program information 
D21 and the video image element and audio information D22 
are read out from the memory 5 based on the operation input 
D3 passed through user interface 4. Then, these items of 
information D22 are video imaged and audio processed based 
on the program information D21 and operation input D4. 
Then, a two-dimensional video image or a three-dimensional 
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vide image concerning a least significant hierarchy of the 
display contents of a spot advertisement video image is 
displayed on a monitor based on the video image processing. 

In addition, in the case where an advertisement 
specific channel is selected, a plurality of electronic 
information contents DO = D21 + D22 are already downloaded 
on the memory 5. When electronic information contents DO 
concerning an arbitrarily selected iadvertisement are read out 
from a plurality of electronic information contents DO 
downloaded on the memory 5, the control device 3 is executed 
to reproduce video image element and audio information D22 
based on the electronic information contents DO, and is 
executed to display and control an advertisement video image 
that consists of a three-dimensional video image. 

In this system 10, a priority is set in advance to any of 
the electronic information contents downloaded from the 
advertisement specific channel. Here, the priority denotes 
contents frequently displayed prior to any other advertisement 
video image. Although the advertisement fee is higher than 
that of another, there are more chances in which the user Hj 
sees and hears. 

In this system 10, for example, before displaying an 
advertisement video image to which a priority is not set or an 
advertisement video image with a low priority, an 
advertisement video image to which such priority is set or an 
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advertisement video image with a high priority is always 
displayed in an initial screen in order to cause the user Hj to 
see and hear it frequently. After ending the display of an 
advertisement video image to which a priority is not set or an 
advertisement video image with a low priority, an 
advertisement video image to which such priority is set or an 
advertisement video image with a high priority may be 
displayed. 

Further, when an advertisement video image to which 
a priority is set is displayed or after that, a control program 
may be executed so as to display a menu screen and select an 
arbitrary electronic information contents DO among the 
electronic information contents DO concerning a plurality of 
advertisements. The user Hj can select electronic 
information contents DO concerning an advertisement in 
desired categories. 

Now, an example of processing of the electronic 
information content distribution processing system 10 
embodied according to the present invention will be described 
here. 

In an example of the present embodiment, assume a 
case in which electronic information contents DO containing 
an advertisement are provided to a user using an existing 
broadcasting infrastructure or communication infrastructure, 
and the electronic information contents DO are information 



processed at the user side. The electronic information 
contents DO concerning an advertisement assumes a case in 
which an advertisement specific channel and a data 
broadcasting program channel are provided. 

<1> In the case of an advertisement specific channel 
First, at the transmission side, at the step Al 
concerning a flowchart shown in FIG. 2 ? the video image 
element and audio information D22 concerning an arbitrary 
interactive advertisement and program information D21 for 
video imaging and processing these items of information D22 
are constructed in a group of data at the data inserter 92. 
The contents of interactive advertisement contain a variety of 
electronic information contents DO including commodities 
such as electric products, automobile, cosmetics, foods, game 
software; and real estates such as apartments or housings or 
the like. The electronic information contents DO consists of 
video image element information such as graphic data or 
sound data and audio information D22; and program 
information D2 1 such as application. 

These electronic information contents DO are provided 
in advance by an interactive advertisement production 
environment, and are carried into a data broadcasting 
program production section. In this production section, 
video image element and audio information D22 concerning a 
plurality of advertisements; and program information D21 are 
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constructed in a series of data. 

Next, at the step A2, data are distributed from the 
transmission side to the receiving side by using an existing 
broadcasting infrastructure or communication infrastructure. 
For example, in the case where data are distributed by the 
broadcast infrastructure, an advertisement specific channel is 
used. Namely, data are transmitted to be multiplexed from 
the transmitter 1 of the information distribution apparatus 19 
to the information processing apparatus 8 of the user Hj by 
using a vertical blanking period of a TV broadcast signal 
caused by a terrestrial wave broadcast. In the future, it is 
possible to directly multiplex the data to a television 
broadcast signal according to a broadcast form which will be 
newly adopted. 

On the receiving side, a group of data sent from the 
information distribution apparatus 19 is received by the 
receiver 2 of each information processing apparatus 8 at the 
step Bl. These data are stored (downloaded) on a non- 
volatile memory 5 or the like. Then, processing goes to the 
step B2 at which the video image element and audio 
information D22 and the program information D2 1 are read 
out asynchronously from the memory 5 according to 
information operation of the user Hj. At this time, the user 
Hj operates operating unit such as controller to provide 
operation input D4 for the control device 3. Then, at the step 



B3, advertisement video image and its audio are reproduced by 
the control device 3 based on the operation input D4 and 
electronic information contents D4. At this time, based on 
the program information D21 read out from the memory 5 to 
the control device 3, the video image element and audio 
information D22 are video imaged and processed by the 
control device 3. 

In this system 10, the video image element and audio 
information D22 are video imaged and processed. In this way, 
an advertisement vide image to which a priority is set or an 
advertisement video image with a high priority is produced so 
as to be always displayed on an initial screen before displaying 
an advertisement video image to which a priority is not set or 
an advertisement video image with a low priority with respect 
to an interactive advertisement, in order to ensure the user Hj 
sees and hears such advertisement frequently. The 
advertisement video image is produced so as to operate a 
two-dimensional video image or a three-dimensional video 
image concerning a lower hierarchy of the display contents of 
a spot advertisement like playing a game. 

Further, when an advertisement video image to which 
a priority is set is displayed or after that, a menu screen is 
displayed, and a control program is executed such that the 
user can select arbitrary electronic information contents DO 
from among the electronic information contents DO concerning 
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a plurality of advertisements. Here, the user Hj is prompted 
to select electronic information contents DO concerning an 
advertisement in a desired category. In this manner, an 
advertisement video image with a low priority or an 
advertisement vide image to which a priority is not set is 
displayed. 

Next, at the step B4, it is judged whether or not an 
interactive advertisement is ended. This judgment is made 
by the user. In the case whether the advertisement is ended, 
for example, the power is turned OFF to end. In the case 
where these processing functions are not ended, processing 
goes to the step B2, for example, at which an advertisement 
video image to which a priority is set or an advertisement vide 
image with a high priority is displayed again. 

<2> In the case of a data broadcasting program 

channel 

First, at the transmission side, at the step Al' of the 
flow chart shown in Fig. 3, there are constructed in advance in 
a group of data; broadcast information contents (video image 
and audio information) D 1 concerning an arbitrary data 
broadcasting program; video image element and audio 
information D22 concerning an arbitrary interactive 
advertisement; and program information D21 for video 
imaging and processing these items of information D22. As 
is the case of an advertisement specific channel, an interactive 



advertisement denotes contents that can be played like a game 
provided in advance in accordance with the interactive 
advertisement production environment. 

Next, at the step A2\ data are distributed from the 
transmission side to the receiving side by using an existing 
broadcasting infrastructure or communication infrastructure. 
For example, data are transmitted to be multiplexed by using a 
vertical blanking period of a TV broadcast signal caused by a 
terrestrial wave broadcast. 

At the step BT ? a group of data are received on the 
receiving side by means of a receiver 2. These data are 
downloaded on a non-volatile memory 5 or the like. Then, 
processing goes to the step B2 f at which a spot advertisement 
concerning an interactive advertisement is always displayed at 
the beginning of a data broadcasting program. Then, the 
step goes to the step B3' at which a control program is 
executed such that the user can select whether to set a 
program reproduction mode or an interactive advertisement 
operating mode. 

Here, in the case where the program reproduction 
mode is selected, processing goes to the step B4' at which the 
broadcast information contents Dl according to a data 
broadcasting program are read out from the memory 5 to the 
control device 3. Then, processing goes to the step B5', at 
which these broadcast information contents Dl are 
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reproduced by the control device 3. 

In addition, in the case where the interactive 
advertisement operation mode is selected at the step B3', 
processing goes to the step B6' at which the program 
information D21 and the video image element and audio 
information D22 are read out from the memory 5 to the control 
device 3. Then, processing goes to the step B7 r at which the 
video image element and audio information D22 is video 
imaged and processed by the control device 3 based on the 
operation input D4, passed through the user interface 4 from 
the operating unit such as controller at which the user Hj 
operates freely and the program information D2 1 read out 
from the memory 5. 

In the present embodiment, the video image element 
and audio information D22 is video imaged and processed. 
In this way, a two-dimensional video image or a three- 
dimensional video image concerning a least significant 
hierarchy of the display contents of a spot advertisement 
concerning an interactive advertisement can be operated like 
playing a game. Then, at the step B8\ an interactive 
advertisement or a data broadcasting program is provided to 
be displayed on a monitor or the like. Then, at the step B9 f , 
it is judged whether or not to end the program reproduction 
mode or the interactive advertisement operating mode and the 
like. This judgment is made by the user. 



In the case where these modes are ended, the power is 
turned OFF, for example. In the case where these modes are 
not ended, processing goes to the step B2' at which a spot 
advertisement concerning an interactive advertisement is 
displayed based on the video image element and audio 
information D22 before displaying a data broadcasting 
program. It should be noted that when the data broadcasting 
program is ended, a spot advertisement may be displayed 
based on the video image element and audio information D22. 

In this manner, in the electronic information content 
distribution processing system 10 embodied according to the 
present invention, any time after receipt of the electronic 
information contents DO, the user can see an advertisement 
video image or hear audio information, the image and 
information being freely processed with respect to an 
advertisement, by the information processing apparatus 8, 
like playing a game, in unreal time (asynchronously). Thus, 
a concept of an advertisement caused by big four mass media, 
the advertisement having been supplied one-sidedly, is 
reversed, whereby an electronic advertisement medium that 
performs an advertisement interactively can be constructed, 
and a new advertisement mass media following such big four 
mass communication media can be created. 

Moreover, an advertisement specific channel that 
distributes only electronic information contents DO 
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concerning an advertisement is used instead of an 
advertisement which the user only sees and hears. Thus, the 
user can download such advertisement at any time he or she 
likes, and can operate video image element and audio 
information D22 concerning an advertisement freely and feels 
more enjoyable. In this manner, the user's interest is 
increased, and an advertiser can implement an advertisement 
with its long life and high advertisement effect. The user can 
handle a commodity virtually, and then, a high advertisement 
effect can be expected. 

Therefore, this makes it possible to contribute to the 
introduction into a demand for a new advertisement industry. 
Hereinafter, embodiments of four interactive advertisement 
systems 100, 200, 300 and 400 will be described. In the case 
where an advertisement specific channel is used, the 
electronic information contents DO consist of program 
information D21 and video image element and audio 
information D22. Thus, the contents are generally referred 
to as interactive advertisement specific program information 
(hereinafter, simply referred to as advertisement information 
D2). 

(2) First Embodiment 

Fig. 4 is an imaginary view showing an exemplary 
configuration of an interactive advertisement system 100 
according to a first embodiment of the present invention. 



A interactive advertisement system 100 shown in Fig. 
4, is equipped with a tuner incorporated entertainment device 
101 that is an example of an information processing apparatus 
and a television 102 that is an example of the monitor device. 
The entertainment device 101 is an example of a composite 
processing apparatus, wherein electronic information 
contents concerning an advertisement (hereinafter, referred to 
as advertisement information D2) and broadcast information 
contents Dl are received and stored. 

A coaxial cable 40 is connected to an entertainment 
device 101 to reach a coaxial terminal 44. An aerial wire 
antenna 42 is connected to this coaxial terminal 44, so that 
advertisement information D2 concerning a data broadcasting 
program and an interactive advertisement as well as TV 
program broadcast caused by a general terrestrial wave are 
received. In addition, an AC plug (alternating current plug) 
48 to which power code 46 is connected is provided at the 
entertainment device 101. The AC plug is connected to a 
power receptacle 50, and a commercially available power (also 
simply referred to as AC power supply) is supplied. 

An interface function and a storage device are further 
provided at this entertainment device 101, and a group of data 
(Dl, D2) from a broadcast station 9 are received, and stored in 
a non-volatile storage device. An external controller 20 is 
connected to this interface. In addition, the data is read out 
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from the storage device to perform video imaging and 
processing. In this example, the external controller 20 is 
used so that the user can operate an interactive advertisement 
freely. 

A television 102 that is an example of a monitor device 
can be connected to this interface. Then, the electronic 
information contents D2 or broadcast information contents Dl 
are read out from the entertainment device 101 according to 
information operation of the user Hj, and an advertisement 
video image and its audio are output after the electronic 
information contents D2 or broadcast information contents Dl 
have been information processed asynchronously. For 
example, an interactive advertisement video imaged and 
processed by the entertainment device 101 or reproduced data 
broadcasting program are displayed on a television screen. 
An exemplary internal configuration of the entertainment 
device 101 will de described in Fig. 8. 

In this example, the advertisement information D2 
according to the present invention together with a data 
broadcasting program being contents is broadcasted from the 
broadcast station 9 for home of a general user, and is received 
by the information processing apparatus 8 via antenna of each 
home. Then, a data broadcasting program or interactive 
advertisement is displayed on a television 102 or a monitor in 
unreal time (asynchronously) relevant to the broadcast station 
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In addition to a specific console such as the above 
mentioned entertainment device 101, a home use game 
machine capable of plugging in a tuner function or a personal 
computer and the like may be used for the information 
processing apparatus. For a display device, there may be 
used an integration type hand held terminal device that 
incorporates a tuner function in addition to an existing 
television 102 or a personal computer monitor. Further, the 
external controller 20 may be of wireless type using infrared 
ray or electric wave in addition to wired type generally used for 
a home use game machine or may be compatible with a remote 
control function generally used for a television 102 or a video 
recorder. 

Now, an information distribution apparatus 19 
disposed at a broadcast station 9 or the like responsible for 
information distribution will be described below. Fig. 5 is a 
block diagram depicting an exemplary configuration of an 
information distribution apparatus 19 and its peripheral 
environment embodied according to the present invention. 
In this example, a data broadcasting infrastructure for 
sending data by using an analog terrestrial wave VBI is used 
for television broadcasting. 

The information distribution apparatus 19 shown in 
Fig. 5 is an apparatus that distributes advertisement 
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information D2 concerning a data broadcasting program and 
an interactive advertisement as well as a TV program 
broadcast caused by general terrestrial waves. In this 
example, a client such as company asks a commercial 
(hereinafter, simply referred to CM) production company 
having interactive advertisement production environment for 
CM production directly or through advertisement agent. 

Through the inquiry of an advertiser 99, 
advertisement information D2 concerning interactive 
advertisement including commodities such as electric 
products, automobiles, cosmetics, foods, game software; and 
real estates such as apartments or housings is produced in 
advance in accordance with an interactive advertisement 
production environment, and many interactive advertisements 
after completed are brought into a data broadcast 
advertisement program production section. In this section, 
broadcast information contents Dl concerning a data 
broadcasting program; video image element and audio 
information D22 such as graphic data or sound data 
concerning an interactive advertisement; advertisement 
information D2 consisting of program information D21 such as 
application are organized in accordance with a CM table 
scheduled in advance. 

A general terrestrial television program is produced 
by a television program production company as usual, and 



another advertiser 99 asks a so called commercial (CM) video 
to be supplied at an interval of such television program. A 
complete packet program produced by a television program 
production company is organized in accordance with a 
program table in a television station, and is broadcasted after 
transmission processing has been done. Namely, the 
information distribution apparatus 19 comprises an inserter 
92 for inserting a data broadcasting program; interface 94; a 
program organization processing unit 93 for a general 
television program; interface 94; a transmitter 95; and an 
antenna 98. 

This inserter 92 is provided as an example of a data 
inserter. This interface 92 is provided to construct at least 
broadcast information contents Dl concerning a data 
broadcasting program Dl; video image element and audio 
information D22 such as graphic data or sound data 
concerning an interactive advertisement; and program 
information D21 such as application in a group of data, and to 
transfer these data to an inserter 29. 

On the other hand, television program information 
and commercial video caused by a terrestrial broadcast are 
provided by a television program production company. The 
television program information and commercial video are sent 
to a transmission interface 94 after organized by a program 
organization processing unit 93 of an information distribution 
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apparatus 19. In the transmission interface 94, the program 
organized television program information and commercial 
video are converted into a predetermined broadcast format, 
and then, the converted data is provided as a TV broadcast 
signal caused by terrestrial wave broadcast (carrying signal). 

An inserter 29 is connected to an output stage of this 
transmission interface 94, and a transmitter 95 is connected 
to its next stage. In a vertical blanking period, for example, 
of the above mentioned TV broadcast signal, the broadcast 
information contents Dl concerning a data broadcasting 
program and advertisement information D2 concerning an 
interactive advertisement are arranged in a group of data, and 
are multiplexed (VBI). This insertion is arranged to be 
performed at midnight. A group of data inserted into this 
inserter 29 is irradiate from an antenna 98 simultaneously by 
means of predetermined distribution power after the data has 
been modulated at the transmitter 95 by means of a 
predetermined modulation system. 

In this manner, the broadcast information contents 
Dl or advertisement information D2 concerning an interactive 
advertisement can be broadcast from the broadcast station 9 
to the user's entertainment device 101. Of course, the 
advertisement information D2 is provided so that the 
information may be distributed to the user Hj through an 
advertisement specific channel that has been assigned in 
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advance (refer to fourth embodiment). In this case, this 
interactive broadcast is irrelevant to an interactive 
advertisement broadcast using the contents main body and 
data broadcast of a terrestrial waves in contents. This means 
that the same distribution infrastructure is used for a totally 
irrelevant receiving system. 

Therefore, in the entertainment device 101 with a 
tuner function, possessed by a user and a hand held terminal 
device as described later, a group of data can be received 
simultaneously in a predetermined period of time, and can be 
stored in batch in a storage device or the like. In this manner, 
after receipt of such data, the user reads out data from the 
storage device at any time he or she likes; video images and 
audio processes video image element and audio information 
D22 based on program information D21 in unreal time 
(asynchronously) irrespective of a television broadcast time; 
reproduces broadcast information contents Dl according to a 
data broadcasting program; displays a data broadcasting 
program such as interactive advertisement or animation on a 
television 102, thereby making it possible to see and hear it 
freely. 

Now, a format of data of program information D21, 
video image element and audio information D22 will be 
described here. With respect to the data shown in Fig. 6, a 
format is provided in advance at a broadcast station 9 or the 
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like, and the data main body is transmitted to be divided into 
each packet. 

In this example, a transfer request command is 
described at the beginning of data so as to enable automatic 
receiving in a tuner device 101 even at midnight. The 
transfer request command is data for initializing (starting up) 
a tuner device 101 in a standby state. A dummy packet 
following this transfer request command is inserted. The 
dummy packet is provided to form a setup period. The setup 
period is a time required for the tuner device 101 to be 
receivable. 

A set of program data is all described after this setup 
period. Program data is described in a bit data format, and 
broadcast information contents Dl concerning a data 
broadcasting program and advertisement information D2 
concerning an interactive advertisement are targeted. 
Program data is nominally described without being 
discriminated from interactive advertisement or program 
codes, video images, or audio information. 

A program start command is described at the 
beginning of the program data, and N + 1 blocks 0 to N are 
described subsequently. Advertisement information D2 
concerning the above mentioned interactive advertisement or 
program codes and content codes of broadcast information 
contents Dl are described in units of blocks. Block 0 is a 



start block, and block N is a last block. Following block N, a 
block last command is described, A block header is 
described at the beginning of each of blocks 0 to N, for example, 
block 1. Header codes, attributes such as the start, middle, 
and end of the block, block length such as the number of 
packets, content codes or the like are described at each block 
header. 

Following this block header, M + 1 packets are 
described in each block. Packet 0 is a start packet, and 
packet M is a last packet. Packet codes, attributes such as 
the start, middle, and end of the packet, error correction codes 
such as parity are described at the packet 1, for example of the 
packets 0 to M. Fig. 7 shows exemplary contents of the 
program information D21 and video image element 
information D22 described in this packet. 

A file header, program information D21, video image 
element and audio information D22 are described at a packet 
shown in Fig. 7. Following the file header, application main 
body containing a polygon drawing command; and program 
information D21 consisting of a module group such as 
subroutine of this application and a library group are 
described. 

In this application, program data is described such 
that the user can select whether to set a program reproduction 
mode, for example, or to set an interactive advertisement 
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operation mode. In addition, a control program is also 
described such that in the case where a priority is set to an 
advertisement video image, when such advertisement video 
image is displayed, the user can select arbitrary 
advertisement information D2 from the advertisement 
information D2 concerning a plurality of advertisements. 

Following this program information D21, video image 
element and audio information D22 are described. For 
example, there is described a graphic model data group 
containing moving image data such that a spot advertisement 
according to the entire appearance of a vehicle, for example, is 
displayed as a two-dimensional or three-dimensional video 
image. The moving image data is compressed by DCT 
(distance cosine transformation). With respect to moving 
image data, apart from the entire appearance of a vehicle, 
there is described two-dimensional or three-dimensional video 
image element data of vehicle sheets, opening and closing 
doors, the inside of the trunk, or engine room or the like 
concerning a least significant hierarchy of its display 
contents. 

Following a graphic model data group, a graphic 
texture data group is described. Furthermore, texture data 
is provided to configure 1 -polygon shape data in 76 bytes. 1 
polygon is expressed by a triangle having three vertexes, and 
texture ID is described at the beginning of shape data. Then, 
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each of the X, Y and Z coordinates of a first vertex of the 
triangle is described, and the color value of the first vertex and 
texture U and V coordinates are described. Subsequently, 
each of the X, Y and Z coordinates of a second vertex is 
described, and the color value and texture U and V coordinates 
of a second vertex are described. Further, each of the X, Y 
and Z coordinates of a third vertex is described, and the color 
value and the texture U, V coordinate of a third vertex is 
described. 

These items of texture data are serially provided so as 
to connect the vertexes of a triangular shape to each other 
according to a user operation. Then, coordinate conversion 
is made for each vertex, raster processing is performed for 
each polygon, and the color texture address (U, V) of each pixel 
is computed. Then, the texture color of the U and V 
coordinates of each pixel is computed by performing raster 
processing for each polygon. Then, the texture color of the U 
and V coordinates are read out from texture data specified by 
texture ID, the color value of each pixel is determined, and a 
three-dimensional advertisement image is displayed on a 
monitor based on this color value. 

In addition, a sound sequence data group is described 
as video image element information, and a sound wave data 
group is described as audio information. Sound wave data is 
processed according to a user operation and sound sequence, 
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and is provided so as to generate door opening and closing 
sound, trunk opening and closing sound, and engine rotation 
sound or the like. These groups of data are provided so as to 
be distributed from the information distribution device 19 to 
the entertainment device 101 or the like within a 
predetermined period of time. 

Now, an exemplary internal configuration of an 
entertainment device 101 applied in an interactive 
advertisement system 100 will be described here. Fig. 8 is a 
block diagram depicting an exemplary internal configuration 
of the entertainment device 10. 

In this example, a user can select a game mode for 
executing a game based of data from an optical disk device; the 
above mentioned program reproduction mode; or interactive 
advertisement operating mode. Namely, the entertainment 
device 101 comprises: a control system 500 consisting of a 
tuner 21 for receiving a group of data (Dl + D2) from an 
information distribution apparatus 19 within a predetermined 
period of time; a non-volatile memory (storage device) 23 for 
storing a group of data received by this tuner 21; a central 
processing unit (CPU) 51 that is a computing unit for reading 
out the program information D21 from the memory 23 to 
arbitrary video imaging and processing video image element 
and audio information D22 based on the program information 
D21,or reproducing a program based on broadcast information 
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contents Dl and its peripheral units or the like; a graphics 
system 600 consisting of a graphic processing unit (GPU) 62 or 
the like for drawing an image in a frame buffer 63; a sound 
system 700 consisting of a sound processing unit (SPU) 71 or 
the like for generating music sound, effect sound or the like; 
an optical disk controller 800 for controlling the optical disk 
in which application program is recorded operated to control 
at least a control system 500; an external controller 20 that is 
an operating unit controlling at least control system 500; a 
communication control system 900 for controlling an input / 
output of data from the external controller 20 and a memory 
card for storing settings of signals and games from an external 
controller 20 to which a user's command is input; a 
communication modem 22 connected to a telephone line or 
Internet; and bus to which each of these units is connected or 
the like. 

This control system 500 comprises a CPU 51; a 
peripheral unit controller 52 for performing interrupt control 
or direct memory access (DMA) transfer control or the like; a 
main memory (main memory device) 53 consisting of a random 
access memory (RAM); and a read only memory (ROM) storing 
programs such as so called operating system managing the 
main memory 53, graphic system 600, and sound system 700 
or the like. The main memory 53 used here can execute a 
program on that memory. When in an interactive 
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advertisement operation mode, program information D2 1 
stored in a memory 23 is used. 

A CPU 51 controls the entirety of this entertainment 
device 101 by executing an operating system stored in a ROM 
54, and consists of a 32 bits RISC-CPU, for example. When 
such interactive advertisement operating mode is executed, 
video image element and audio information D22 are video 
imaged and processed based on program information D2 1 read 
out from the memory 23. A flash memory such as EEPROM is 
used for a non-volatile memory 23. When a RAM is used, a 
backup power source or the like is used to provide non-volatile 
properties. 

When this entertainment device 101 is powered ON, 
the CPU 51 of the control system 500 executes an operating 
system stored in the ROM 54 or memory 23 according to the 
game mode, program reproduction mode or interactive 
advertisement operating mode. In this manner, the CPU 5 1 
controls a graphic system 600 or sound system 700 and the 
like. 

In addition, when an operating system is executed, 
the CPU 51 initializes the entirety of the entertainment device 
101 such as operational checks. Then, the CPU 51 controls 
this optical disk controller 800. When in a game mode, the 
CPU executes an application program such as game recorded 
in an optical disk. In this example, when in an interactive 
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advertisement operating mode, operation substantially 
identical to game mode can be performed based on the 
program information D21 and video image element and audio 
information D22 read out from the memory 23. 

Therefore, by executing a program such as game mode 
or interactive advertisement operating mode, the CPU 51 
controls this graphic system 600 or sound system 700 and the 
like according to the user input so as to control image display 
or generation of an effect or music sound and the like. 

In addition, this graphic system 600 displays and 
controls at least advertisement video image or program video 
image operated by the external controller 20. The graphic 
system comprises: a geometry transfer engine (GTE) 61 that 
processes coordinate conversion or the like that configures a 
computing uniti; a GPU 62 that draws an image in accordance 
with an image drawing command from the CPU 51; a frame 
buffer 63 for storing an image drawn by this GPU 62; and an 
image decoder 64 for decoding image data compressed and 
encoded by orthogonal conversion such as discrete cosine 
conversion. A television 102 is connected to the GPU 62, and 
video output signals <£» v such as the game video image, data 
broadcasting program video image and interactive 
advertisement video image are supplied to the GPU 62. 

This GTE 61 comprises a parallel computation 
mechanism that executes a plurality of computations in 
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parallel, for example so that computations such as coordinate 
conversion, light source calculation, matrix or vectors can be 
performed speedily according to a computation request from 
this CPU 51. Specifically, in the case of computation for 
performing flat shading for image drawing a polygon of one 
triangular shape in the same color, for example, this GTE 61 
can perform coordinate computation for a maximum of about 
1,500,000 polygons per second, whereby this entertainment 
device 101 can reduce a burden of the CPU 51, and perform 
high speed coordinate computation. 

In addition, this GPU 62 draws an image such as 
polygon relevant to a frame buffer 63 in accordance with a 
image drawing command from the CPU 51. This GPU 62 can 
perform image drawing for a maximum of about 360,000 
polygons per second. Further, this frame buffer 63 consists 
of a so called dual port RAM. The buffer can perform 
transferring of image drawing from the GPU 62, or from the 
main memory 53 or the memory 23, and readout for display, 
simultaneously. 

This frame buffer 63 has a capacity, for example, of 
1M byte, and is handled as a matrix that consists of 1024 
pixels horizontally and 512 pixels vertically, respectively, in 
16 bits. In addition, in this frame buffer 63, apart from a 
display region output as a video output, there are provided a 
CLUT region for storing a color lookup table (CLUT) to be 
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referred to when the GPU 62 draws an image such as polygon; 
and a texture region for storing an element (texture) to be 
inserted (mapped) in a polygon or the like coordinate 
converted during image drawing and image drawn by the GPU 
62. These CLUT region and texture region are dynamically 
changed in accordance with display region change or the like. 

This GPU 62 can perform: grow shading for causing 
interpolation from a color of a polygon vertex, thereby 
determining the color in the polygon, apart from the above 
mentioned flat shading; and texture mapping for mapping a 
texture stored in this texture region to the polygon. In the 
case where these grow shading or texture mapping is 
performed, this GTE 61 can perform coordinate computation 
for a maximum of about 500,000 polygons per second. 

Further, an image decoder 64, under control of this 
CPU 51, provided to decode and store in the main memory 53 
is image data which is on still image or moving image 
concerning game, data broadcasting program or advertisement 
and stored in a main memory 53 or memory 23. The audio 
and video image information Dl reproducing a data 
broadcasting program or image data reproduced by an optical 
disk device is stored in a frame buffer 63 via the GPU 62, 
whereby these information or data can be used as a 
background of an image drawn by the above mentioned GPU 
62. 
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A sound system 700 comprises: an SPU 71 for 
generating a music or effect sound based on a command from 
the CPU 51; a sound buffer 72 for recording waveform data or 
the like or recording sound data concerning interactive 
advertisements stored in the memory 23; and a speaker 73 for 
outputting a music or effect sound generated by the SPU 71. 

The SPU 7 1 comprises an ADPCM decoding function 
for reproducing audio data generated by adaptively predicting 
and encoding (ADPCM: Adaptive Differential PCM) a 16-bit 
audio data as a 4-bit differential signal; a reproduction 
function for reproducing waveform data stored in the sound 
buffer 72, thereby generating an effect sound or the like; and a 
modulation function or the like for modulating and 
reproducing waveform data stored in the sound buffer 72. 

By providing such function this sound system 700 can 
be used as a so called sampling sound source for generating a 
music or effect sound or the like based on waveform data 
recorded in a sound buffer 72 by a command from the CPU 51. 
This optical disk controller 800 comprises: an optical disk 
device 81 for reproducing programs or data and the like 
recorded in an optical disk; a decoder 82 for decoding 
programs or data and the like recorded with error correction 
codes (ECC) added thereto; and a buffer 83 for speedily 
reading out data from an optical disk by temporarily storing 
data from the optical disk device 81. 
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In addition, audio data recorded in an optical disk 
read out by the optical disk device 81 includes so called PCM 
data obtained by analog / digital converting an audio signal as 
well as the above mentioned ADPCM data. As ADPCM data, 
audio data recorded with a difference in 16-bit digital data 
being expressed in 4 bits is decoded by means of a decoder 82. 
The decoded data is supplied to the above mentioned SPU 71. 
Then, the supplied data is subjected to processing such as 
digital / analog conversion in the SPU 71, and then, is used to 
drive the speaker 73. In addition, as PCM data, for example, 
audio data recorded as 16-bit digital data is decoded by means 
of the decoder 82, and then, is used to drive the speaker 73. 

Further, a communication control system 900 
comprises: a communication controller 91 that controls 
communication with the CPU 51 via a bus; and a 
communication modem 22 for receiving also advertisement 
information D2 or the like concerning an interactive 
advertisement. A controller connection terminal 12 is 
connected to the communication controller 91, and an 
external controller 20 for inputting operation input D3 from 
the user is connected. A telephone line or Internet is 
connected to the communication modem 22. In addition, a 
memory card inserter to which a memory card or a hand held 
terminal device or the like is connected as an auxiliary storage 
device for strong game setting data or the like is provided at 
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this communication controller 91 (not shown). 

The external controller 20 connected to this controller 
connection terminal 12 has 16 command keys, for example, to 
input a command from the user. The states of these 
command key are distributed to the communication controller 
91 about 60 times per second by synchronous communication 
in accordance with a command from the communication 
controller 91. Then, the communication controller 91 
distributes the state of a command key of the external 
controller 20 to the CPU 51. In this way, the command from 
the user is input to a CPU 51. This CPU can perform 
processing in accordance with a user command based on the 
interactive advertisement operating mode or game mode and 
the like being executed. 

Here, it is required to transfer a large amount of data 
at a high speed when a program is read out or an image is 
displayed or drawn among the memory 23, main memory 53, 
GPU 62, image decoder 64, and decoder 82 or the like. At 
this entertainment device 101, as described above, so called 
DMA transfer for directly transferring data among the main 
memory 53, GPU 62, image decoder 64 and decoder 82 or the 
like can be performed under the control of a controller 52 of a 
peripheral device without intervening the CPU 51. 
In this manner, a burden of the CPU 51 caused by data 
transfer can be reduced, and high speed data transfer can be 
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performed. In addition, a parallel I/O interface (PIO) 96 and 
a serial I/O interface (SIO) 97 are interfaces for connecting an 
external expansion device and the entertainment device 101 to 
each other. 

Now, an example of processing in an interactive 
advertisement system 100 will be described here by using the 
flow chart at the receiver side shown in Fig. 3. 

In the present embodiment, assume a case in which 
data concerning a data broadcasting program or interactive 
advertisement are distributed from the broadcast station 9 to 
the entertainment device 101 by using an existing terrestrial 
wave broadcasting infrastructure. Such case is exemplified 
that at the transmission side, broadcast information contents 
Dl concerning a data broadcasting program, and for example, 
advertisement information D2 concerning vehicle sales are 
provided, and these data are transmitted to be multiplexed by 
using a vertical blanking period of a TV broadcast signal. 
Assume a case in which game mode is determined in advance 
not to be selected 

With these cases being assumed, at the receiver side, 
when a predetermined time comes, a transfer request 
command is automatically received. After the setup period, 
at the step Bl in the flow chart shown in Fig. 3, the broadcast 
information contents Dl concerning a data broadcasting 
program and a group of data consisting of advertisement 
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information D2 concerning vehicle sales are received by means 
of a tuner 21 through an antenna 42, a coaxial terminal 44, 
and a coaxial cable 40. These data are decoded by means of a 
decoder circuit (not shown) incorporated in the tuner 21, and 
then, is writing controlled by means of the CPU 51 to be stored 
in a non-volatile memory 23 or a main memory 53 with a 
backup function. 

When all the data are received, it reverts to a standby 
state. Then, the standby state is released, for example, and 
processing goes to the step B2\ At this step, if a game mode 
is set to be deselected, a spot advertisement according to the 
appearance of the entire vehicle is always displayed as a 
two-dimensional or three-dimensional image with respect to 
an interactive advertisement at the beginning of a data 
broadcasting program. Then, processing goes to the step B3' 
at which a application is executed such that the user can 
select whether or to set a program broadcast mode or to set an 
interactive advertisement operating mode. 

Here, in the case where the program reproduction 
mode is selected, processing goes to the step B4 ? at which 
broadcast information contents (audio and video image 
information) Dl according to a data broadcasting program are 
read out from the memory 23 to a control system 500. Then, 
processing goes to the step B5 1 at which a graphic system 600, 
a sound system 700 or the like is controlled by means of a 
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control system 500, whereby the broadcast information 
contents Dl are reproduced. 

In addition, in the case where the interactive 
advertisement operating mode is selected at the step B3', 
processing goes to the step B6' at which program information 
D21 and video image element and audio information D22 
according to an interactive advertisement of a vehicle are read 
out from the memory 23 to the controller 500. Then, 
processing goes to the step B7' at which the graphic system 
600, sound system 700 and the like are controlled by means of 
the control system 500 based on operation input D4 from the 
external controller 20 that the user operates freely and the 
program information D21 read out from the memory 23, 
whereby the video image element and audio information D22 
are subject to video image processing such that a three- 
dimensional and high resolution video image when a vehicle is 
seen at a variety of angles is displayed. 

In this example, the video image element and audio 
information D22 are video imaged and processed by means of 
the CPU 51, whereby a three-dimensional image of vehicle 
sheets, door opening and closing, the inside of the trunk, and 
the inside of engine room or the like can be operated with 
respect to the least significant hierarchy of the display 
contents of the spot advertisement of a vehicle like playing a 
game. At the step B8', an interactive advertisement or data 
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broadcasting program is provided so as to be displayed on a 
television 102 or the like. At the step B9', it is judged 
whether or not the game mode, program reproduction mode, or 
interactive advertisement operating mode and the like is 
ended. This judgment is made by the user. 

In the case where these modes are ended, power is 
turned OFF, for example. In the case where these modes are 
not ended, processing reverts to the step B2' at which a spot 
advertisement concerning an interactive advertisement is 
displayed based on video image element and audio information 
D22 before displaying a data broadcasting program. When 
the data broadcasting program is ended, a spot advertisement 
may be displayed based on the video image element and audio 
information D22. 

In this manner, in the interactive advertisement 
system 100 that is a first embodiment according to the present 
invention, an interactive advertisement or reproduced data 
broadcasting program consisting of a three-dimensional video 
image of vehicle sheet, door opening or closing, the inside of 
the trunk, or the inside of engine room, which are video 
imaged and processed by the control system 500, graphic 
system 600 and sound system 700 asynchronously relevant to 
a terrestrial broadcast is displayed on the television 102 or the 
like, whereby the user can see or hear it freely at any time he 
or she likes or can play it like playing a game. 



In this way, a concept of big four mass media 
advertisement, the advertisement having been supplied one- 
sidedly, is reversed, and a new generation electronic 
advertisement medium for interactively performing 
advertisement can be constructed. Moreover, the user can 
operate an interactive advertisement enjoyably by using an 
external controller 20 like playing a game as compared with a 
conventional type of advertisement that has only been seen or 
heard. Thus, in the future, an interactive advertisement can 
be expected to naturally spread in an increased number of 
users who likes to play a game. 

The user's interest is increased unconsciously, and 
thus, an advertise 99 can carry out an advertisement with its 
high advertisement effect. This greatly contributes to the 
introduction into a demand for new interactive advertisement 
industry. In this manner, new game media following arcade 
game, home use game machine, hand held game machine or 
the like can be created. That is, a new media fusing the 
entertainment device 101 and advertisement can be created. 

(3) Second Embodiment 

FIG. 9 is an imaginary view showing an exemplary 
configuration of an interactive advertisement system 200 that 
is a second embodiment according to the present invention, 

In this system 200, a system for seeing and hearing an 
interactive advertisement is configured by a hand held 
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terminal device 14 shown in Fig. 9, instead of the television 
102 applied in the first embodiment. As an information 
processing apparatus, a tuner device 24 with a power charge 
function and a hand held terminal device 14 mountable to this 
tuner device 24 are provided, and a non-volatile storage device 
for storing data is provided in the tuner device 24. 

This tuner device 24 is similar to that in the first 
embodiment in that the advertisement information D2 
according to a data broadcasting program and an interactive 
advertisement is received and stored. Instead of outputting 
this information to the television 102, and operating an 
interactive advertisement by means of the external controller 
20, the broadcast information contents Dl concerning a data 
broadcasting program stored in the tuner device 24 and the 
advertisement information D2 concerning an interactive 
advertisement are downloaded on the hand held terminal 
device 14, so that the user operates the video image or audio 
concerning an interactive advertisement by using a liquid 
crystal display monitor 122 and an operation key 32 of the 
hand held terminal device 14. 

A general-purpose serial interface (wired or wireless) 
such as USB or IEEE 1394 and IrDA is used for downloading 
from this tuner device 24 to the hand held terminal device 14. 
In addition, a dedicated interface or the like for directly 
connecting a wired device, a wireless device, or a connector 
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may be provided at the tuner device 24. The data received by 
the tuner device 24 may be directly stored in a non-volatile 
memory or hard disk unit in the hand held terminal device 14 
without being stored in the tuner device. 

The tuner device 24 with the power charge function 
shown in Fig. 9 has a tuner (not shown) so as to receive a 
group of data such as the broadcast information contents Dl 
or advertisement information D2 or the like distributed from 
the broadcast station 9. The hand held terminal device 14 
can be connected to the tuner device 24, and a group of data 
downloaded from the tuner device 24 are image processed. 

This hand held terminal device 14 comprises an 
operation key 32 and a liquid crystal display monitor 122 that 
is a display unit. The interactive advertisement video image 
or data broadcasting program operated by this operation key 
32 are displayed on the liquid crystal display monitor 122. 

This liquid crystal display monitor 122 has, for 
example, a color liquid crystal screen with 320 pixels x 240 
pixels. At its lower end side, this hand held terminal device 
14 is inserted into a recess 18 of the tuner device 24, whereby 
a secondary battery incorporated in this hand held terminal 
14 is charged. 

At a casing 26 of the hand held terminal device 14, 
apart from the above mentioned liquid crystal display monitor 
122, there are provided a cross key 28 and an OK key 30 
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configuring the operation key 32. Although the cross key 28 
and OK key 30 are operated to control a computing unit 
described later, the OK key functions as a power switch of the 
hand held terminal device 14. 

On the other hand, at a casing 34 of the tuner device 
24 with a power charge function, apart from the above recess 
18, there are provided a power charge display lamp 36 
indicating a charge state such as the progress or end of power 
charge; a reception indicating lamp 37 indicating that the 
hand held terminal device 14 is receiving data; a channel 
selection switch 38 for selecting a desired broadcast channel 
in a data broadcast. The advertisement specific program 
channel can be seen and heard when the channel selection 
switch 38 is set to channel 100, for example. Of course, in 
this case, the channel 100 is used as an advertisement specific 
channel at the broadcast station 9. 

Further, a coaxial cable 40 is connected to this tuner 
device 24 with a power charge function to reach a coaxial 
terminal 44. An aerial wire antenna 42 is connected to this 
coaxial terminal 44, so that advertisement information D2 
concerning a data broadcasting program and an interactive 
advertisement as well as TV program broadcast caused by a 
general terrestrial wave are received. In addition, an AC plug 
(alternating current plug) 48 to which power code 46 is 
connected is provided at the tuner device 24. The AC plug is 



connected to a power receptacle 50, and a commercially 
available power (simply referred to as AC power supply) is 
supplied. 

FIG. 10 is a block diagram depicting an exemplary 
internal configuration of the tuner device 24 and hand held 
terminal device 14. In FIG. 10, the tuner device 24 with its 
power charge function has a tuner 55 for receiving externally 
supplied data. This tuner 55 extracts data such as broadcast 
information contents Dl according to a data broadcasting 
program or advertisement information D2 according to an 
interactive advertisement from the terrestrial wave broadcast 
signal received by the antenna 42, and sends them to a bus 57. 

In the present embodiment, the broadcast information 
contents Dl according to a data broadcasting program or 
advertisement information D2 according to an interactive 
advertisement are multiplexed, for example, by using a 
vertical blanking interleaving interval (VBI) that is an interval 
of electronic broadcast waves using an NTCS system that is a 
terrestrial wave television broadcast. A variety of digital 
contents can be distributed (the contents used here include a 
variety of information such as video images, images (moving 
and still pictures), audio, characters, numerals; a program or 
CM reproduced by a television receiver or radio receiver; and 
the contents of journals or newspaper). Therefore, the 
television broadcast waves of this terrestrial waves can be 
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received by means of the antenna 42 such as conventional Yagi 
antenna. 

Television broadcast waves include a plurality of 
channel waves. In order to select and receive a desired 
channel, the selection frequency of a tuner 55 can be switched 
through a channel selection circuit 56 based on the channel 
information set by the channel selection switch 38 (also refer 
to Fig. 9). 

The data (here, referred to as NTSC signal) selected by 
this tuner 55 and supplied to a bus 57 is decoded by means of 
a data decoding circuit 58. When a data according to the 
above various contents multiplexed as a VBI is present in such 
NTSC signal, the decoded data such as broadcast information 
contents Dl, program information D21, and video image 
element and audio information D22 is temporarily stored in a 
flash memory 33, including a case in which a hand held 
terminal device 14 is not set under the control of a 
microcomputer 90 that functions as a reception controller or 
the like. 

When the hand held terminal device 14 is set, data 
may be directly transferred simultaneously to the hand held 
terminal device 14 through an external interface 60 that is a 
serial interface or a connection terminal 65. In this case, the 
data decoding circuit 58 and microcomputer 90 may be 
configured in an integrated system LSI. The data sent to the 
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hand held terminal device 14 through the connection terminal 
65 is electrically written in a data storage 75 or flash memory 
43 that is an example of a non-volatile storage device under 
the control of a microcomputer 70 through a connection 
terminal 69 of this hand held terminal device 14, an external 
interface 67 and a bus 74 that are serial interfaces. 

A read only memory (EEPROM) or the like in which 
information can be written and erased is used for this storage 
device. In this example, even if the hand held terminal device 
14 is not set to a tuner device 24, data such as broadcast 
information contents Dl or advertisement information D2 are 
electrically stored in the flash memory 33. When the hand 
held terminal device 14 is set to the tuner device 24, data are 
transferred to a data storage (storage device) 75 of the hand 
held terminal device 14 under the control of a microcomputer 
90. 

The storage capacity of flash memories 33 and 43 or 
data storage 75 may be 16 [MB] in the case where a data rate 
of a data broadcast is about 40 [kbps] and an attempt is made 
to store the data at least for about 50 minutes. 40 [kbps] / 8 
[bits] x 50 [minutes] x 60 [seconds] = 15 [MB]. 

The micro computer 70 is a digital computer that is 
provided as an example of a computing unit. This computer 
arbitrarily video images and processes the video image 
element and audio information D22 based on the program 
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information D21 read out from the data storage 75 or 
reproduces a complete packet program based on the broadcast 
information contents Dl. 

The microcomputers 70 and 90 each have: CPU 
(central processing device); a ROM (including EEPROM) that is 
a memory; a RAM (random access memory): an input / output 
interface, a clock that is a clock device; and a time that is a 
timer device or the like, and functions as a controller, a 
computing unit, a processing unit or the like. Therefore, as 
described above, the function of the data decoding circuit 58 
can be executed by means of the microcomputer 90. 

A reception indicating lamp 37 is connected to the 
microcomputer 90 at the side of the tuner device 24. This 
reception indicating lamp 37 is controlled to turn ON while 
data is transferred from the tuner device 24 to the data storage 
75 and while data is stored in the data storage 75 and to turn 
OFF in the other cases. The reception indicating lamp 37 
may blink when data reception has been completed. 

The tuner device 24 further has a power circuit 80. 
This power circuit 80 converts an alternating current voltage 
such as 100 ACV supplied from an external AC power source to 
direct current voltage, and supplies the voltage to all the 
blocks in the tuner device 24. In this case, a power charge 
control circuit 85 converts the direct current voltage supplied 
from the power circuit 80 into a power charge direct current, 
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for example, supplies the current to a secondary battery 87 of 
the hand held terminal device 14 via a connection terminal 68 
of the hand held terminal device 14 through the connection 
terminal 66, and controls power charge. The power charge 
control included in the power charge control circuit 85 
controls a charge current while detecting a temperature of a 
secondary battery 87, and performs remaining capacity 
detection and control and battery full charge detection and 
control of the secondary battery 87. As the secondary 
battery 87, a lithium ion battery or nickel hydrogen battery 
and the like can be used. 

A charge indicating lamp 36 is connected to the 
charge control circuit 85. This charge indicating lamp 36 is 
controlled to turn ON while the power of the secondary battery 
87 is charged and to turn OFF when the battery is full. 
Further, the operation key 32 is connected to the hand held 
terminal device 14 via a bus 74 and an interface 86, and a 
liquid crystal display monitor 122 is connected thereto via a 
liquid crystal display controller (LCDC) 88. An audio 
processing unit 76 is connected to the above mentioned bus 74, 
and audio amplification processing or the like is performed. 
A speaker 77 is connected to an audio processing unit 76 so as 
to output audio information concerning a data broadcasting 
program or interactive advertisement. 

Now, an example of processing in an interactive 
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advertisement system 200 will be described here. FIG. 1 1 is 
a flow chart showing an exemplary operation of a hand held 
terminal device 14 in the system 200. 

In this example as well, data are configured by 
broadcast information contents Dl concerning a data 
broadcasting program (contents) and advertisement 
information D2 concerning an interactive advertisement so 
that the data are distributed from the broadcast station 9 to 
the user. The program used here includes moving pictures or 
comics such as photographs or animation; still picture such 
as electronic program table; and software (data) such as game, 
music, character information. An advertisement is organized 
so as to appear between these programs in a spot manner, and 
produced by software programs including image or audio data. 

In this example, the hand held terminal device 14 is 
set to the tuner device 24. In a data download wait state, the 
tuner device 24 enters a standby mode. The standby mode 
used here denotes a state in which a system LSI such as 
microcomputer 70 or LCDC 88 of the hand held terminal 
device 14 is turned OFF excluding the interface function with 
respect to the microcomputer 90 of the tuner device 24 and 
clock function. 

In this interface function as well, unlike general data 
transfer, a startup command from the microcomputer 90 can 
be polled at a required minimum low rate. The tuner device 
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24 is supplied with power from a power circuit 80 to each unit 
to detect transfer request command. In addition, the hand 
held terminal device 14 is set to the tuner device 24, and thus, 
a secondary battery 87 is charged by means of the power 
charge control circuit 85 during this setting. 

With this being presumed, in the tuner device 24, a 
transfer request command distributed from the broadcast 
station 9 is detected during a standby mode at the step CI in 
the flow chart shown in FIG. 11. In the case where the 
transfer request command is detected by the tuner device 24, 
the transfer request command for notifying the start of 
downloading is transferred from the tuner device 24 to the 
hand held terminal device 14. Thus, at the hand held 
terminal device 14, using a setup period, the microcomputer 
70 itself starts up the hand held terminal device 14 in a 
receiving mode at the step C2. 

The receiving mode used here denotes an intermediate 
mode between a standby mode and a normal (general use) 
mode. The microcomputer 70 enters a state in which, in 
addition to the standby function, a high speed interface 
function with the tuner device 24 and an external memory 
interface function for transferring the acquired data to the 
data storage 75 such as flash memory are further turned ON. 
Therefore, at this time, power is supplied from the secondary 
battery 87 to the data storage 75 and microcomputer 70 and 
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the like. 

Then, processing goes to the step C3 at which the 
reception indicating lamp 37 indicating that data are being 
received is turned ON by means of the microcomputer 90 of the 
tuner device 24. The power charge indicating lamp 36 is 
turned ON because the hand held terminal device 14 is set to 
the tuner device 24. The hand held terminal device 14 waits 
for a program start command from the tuner device 24. 

At the step C4, whether a program start command is 
described with respect to a data following a setup period is 
detected by means of the microcomputer 90. This program 
start command is a signal that notifies that transfer of all the 
programs downloaded one time is started. The data on all the 
programs is divided into a plurality of blocks as described in 
Fig. 6 and Fig. 7. Therefore, when block start command is 
received (detected), processing goes to the step C5 at which 
whether or not a block header is described in packets of the 
first (start) block is detected. 

In the case where this block header is detected, 
processing goes to the step C6 at which packet-like data 
groups finely divided in blocks are placed in the 
microcomputers 70 and 90, and packet transfer processing is 
executed while a handshake is taken. During this transfer 
processing, there is a case in which an external flash memory 
43 as well as data storage 75 is applied. Thus, this transfer 
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processing also contains processing for transferring data to 
this flash memory 43 at any time. Namely, in the tuner 
device 24, when a data is received, the data is conveniently 
decoded to binary data by means of the data decoding circuit 
58. 

As a decoded data file, the broadcast information 
contents Dl concerning a data broadcasting program and the 
advertisement information D2 concerning an interactive 
advertisement are transferred to be temporarily stored in the 
flash memory 33 or the like. In this example, the decoded 
data file is transferred simultaneously to the flash memory 33 
and the storage 75 of the hand held terminal 14. Thus, even 
in the case where the user fails to set the hand held terminal 
device 14 to the tuner device 24, the data file can be re- 
transferred from the tuner device 24 to the hand held terminal 
device 14 after the file has been received. 

At the end of this packet, an end flag indicating the 
end of the block is described. Thus, when the microcomputer 
70 recognizes this fact, processing goes to the step C7 at 
which whether or not a program end command following the 
packet end flag is described is detected. In the case where 
the program end flag is not detected, processing goes back to 
the step C5 at which whether or not the next block header is 
described is continuously detected. 

In this way, data files are transferred one after 
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another from the tuner device 24 to the data storage 75 or an 
external flash memory 43 depending on the model of the hand 
held terminal device 14 until the program end command has 
been detected. When all the data are temporarily recorded in 
the flash memory 33 or data storage 75, external flash memory 
43 and the like according to a buffer memory in the 
microcomputer 70, processing goes to the step C8 at which the 
reception indicating lamp 37 of the tuner device 24 is turned 
OFF by means of the microcomputer 90. A "receiving" 
indicator 47 of the hand held terminal device 14 is turned OFF 
by means of the microcomputer 70 that has received the 
program end command. 

Then, processing goes to the step C9 at which a 
"received" lamps blink at the tuner device 24 and the hand 
held terminal device 14. The "received" lamp may be 
compatible with the reception indicating lamp 37 or the 
"receiving" indicator 47. Processing goes to the step CIO at 
which the hand held terminal device 14 enters a standby 
mode. 

Now, an exemplary operation of a hand held terminal 
device 14 in an interactive advertisement system 200 will be 
described here. FIG. 12 is a flow chart showing an exemplary 
operation (main routine) of the hand held terminal device 14 in 
the interactive advertisement system 200. This example 
assumes a case in which the hand held terminal device 14 is 
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removed from the tuner device 24 shown in FIG. 10; and an 
interactive advertisement itself is seen or heard and operated 
in any times the user likes by using advertisement information 
D2 stored in the data storage 75 of this hand in held terminal 
device 14 or external flash memory 43. Here is exemplified a 
case in which the contents downloaded from the transmission 
side include moving pictures or comics such as photographs or 
animation concerning a data broadcasting program; still 
pictures such as electronic program table or broadcast 
information contents Dl such as game, music, character 
information; and, for example, advertisement information D2 
concerning vehicle sale. 

With this being presumed, when the user turns ON the 
power source of the hand held terminal device 14 at the step 
El in the flow chart shown in FIG. 12, a system LSI consisting 
of the external interface 67, microcomputer 70, interface 86, 
and LCDC 88 enters a normal mode in which all the circuits 
are operable from the standby mode. Then, at the step E2, a 
first spot advertisement concerning an interactive 
advertisement, the entire appearance of a vehicle in this 
example, is displayed directly. 

Then, at the step E3, a menu screen is provided to be 
displayed on a liquid crystal displaying monitor 122. On this 
menu screen, some of data broadcast programs such as 
moving pictures such as photographs or animation; still 
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picture such as comics or electronic program table; or game, 
music, character information, are displayed. These data 
broadcasting programs are defined as applications A, B, C, 
D, ... . The user is prompted to select any one of these 
applications A, B, C, D, ... . 

Then, at the step E4, the user is prompted such that 
the user can select whether to set a program reproduction 
mode or to set an interactive advertisement operating mode. 
In the case where a program reproduction mode is selected, 
processing goes to the step E5 at which the broadcast 
information contents Dl concerning the previously selected 
application A is read out from the data storage 75 or external 
flash memory 43. Then, at the step E6, the video image 
information and audio information according to the 
application A are reproduced. 

In addition, in the case where the interactive 
advertisement operating mode is selected at the step E4, 
processing goes to the step E7 at which the program 
information D21 and the video image element and audio 
information D22 concerning an interactive advertisement are 
read out from the data storage 75 or external flash memory 43. 
Then, at the step E8, a video image according to an interactive 
advertisement is processed. 

For example, by calling a subroutine shown in FIG. 13, 
a two-dimensional or three-dimensional video image of a spot 
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advertisement of a vehicle is displayed on a liquid crystal 
display monitor 122 with respect to an interactive 
advertisement at the step Fl. Then, processing goes to the 
step F2 at which a menu screen is displayed on the liquid 
crystal display monitor 122. On this menu screen, the menu 
concerning how to operate an interactive advertisement or the 
like is displayed together with operating procedures. Then, 
the user is prompted such that the user can select whether to 
set an entire operation mode for video imaging and processing 
the entire vehicle or to set a partial operation mode for 
processing a partial video image of the vehicle at the step F3. 

In the case where the entire operation mode is 
selected, for example, processing goes to the step F4 at which 
it is checked whether or not the entire video image of the 
vehicle is rotated. In the case where the entire video image is 
rotated, processing goes to the step F5 at which the rotation 
processing of that video image is done. In the case where the 
entire video image of the vehicle is not rotated, processing 
goes to the step F6 at which it is checked, for example, 
whether or not the entire video image is expanded. In the 
case where the entire video image is rotated, processing goes 
to the step F7 at which expansion processing of vide image 
information is done. In the case where the entire video image 
is not expanded, processing goes to the step F8 at which it is 
checked whether or not the entire video image of the vehicle, 
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for example, is reduced. In the case where the entire video 
image is reduced, processing goes to the step F7 at which 
reduction processing of video image information is done. 

In the case where the entire video image of the vehicle 
is not reduced, processing goes to the step F10 at which it is 
checked whether or not the color of the video image is changed, 
for example. In the case where the video image of the vehicle 
is changed in color, processing goes to the step Fll at which 
the color change processing of the video image is done. At 
this time, for example, a red colored vehicle is displayed to be 
changed to a blue colored vehicle. When processing is ended 
at each of the steps F5, F7, F9 and Fll, processing goes back 
to the step F3 at which the user is prompted such that the user 
can select whether the entire operation mode is set or the 
partial operation mode is set. 

Therefore, in the case where the partial operation 
mode is set at the step F3, processing goes to the step F12 at 
which it is checked whether or not the partial video image of 
the vehicle, for example, engine room, vehicle sheet, trunk 
room is rotated. In the case where these partial video images 
are rotated, processing goes to the step F13 at which the 
rotation processing of video image information is done. 

In the case where the partial video image of the vehicle 
is not rotated, processing goes to the step F14 at which it is 
checked whether the partial video image is expanded, for 
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example. In the case where the partial video image is 
expanded, processing goes to the step F15 at which the 
expansion processing of video image information is done. In 
the case where the partial video image is not expanded, 
processing goes to the step F16 at which it is checked whether 
or not the partial video image is reduced, for example. In the 
case where the partial video image is reduced, processing goes 
to the step F17 at which the reduction processing of the partial 
video image is done. 

In the case where the partial video image of the vehicle 
is not reduced, processing goes to the step F18 at which it is 
checked whether or not the partial video image is changed in 
color. In the case where the partial video image is changed in 
color, processing goes back to the step F19 at which the color 
change processing of the partial video image is done. At this 
time, for example, black and silver colored sheets can be 
changed to red sheets. When processing is ended at each of 
the steps F13, F15, F17 and F19, processing goes back to the 
step F3 at which the user is prompted to select whether to set 
the entire operation mode or to set the partial operation mode. 
In addition, in the case where the entire video image or the 
partial video image is not changed in color at the step F10, F18, 
processing goes to the step F20 at which it is judged whether 
or not video image processing concerning an interactive 
advertisement is ended. This judgment is made by the user. 
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In the case where this video image processing is not 
ended, processing goes back to the step Fl at which a program 
is continued. In the case where this video image processing 
is ended, it returns to the step E8 of the main routine shown in 
FIG. 12. Then, a video image is displayed, and an audio is 
output at the step E9. Then, processing goes to the step E10 
at which it is judged whether or not a program reproduction 
mode or interactive advertisement operation mode and the like 
is ended. This judgment is made by the user. In the case 
where the user sees and hears applications A and B, 
processing goes back to the step E2 at which a spot 
advertisement concerning an interactive advertisement is 
displayed again. 

In the case where these modes are ended, for example, 
processing goes to the step Ell at which a liquid crystal 
display monitor 122 is set to a clock screen, and processing 
goes to the step E12 at which the power source is turned OFF, 
thereby entering a standby mode. In the case where these 
modes are not ended, processing goes back to the step E2 at 
which a spot advertisement concerning an interactive 
advertisement is displayed based on video image element and 
audio information D22 before displaying a data broadcasting 
program. When the data broadcasting program is ended, a 
spot advertisement concerning an advertisement based on 
these items of information D22 may be displayed. 
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As described above, in the interactive advertisement 
system 200 according to the second embodiment of the present 
invention, unlike a conventional advertisement of television or 
radio broadcast, there is used advertisement information D2 
temporarily stored in the data storage 75 of the hand held 
terminal device 14 or an external flash memory 43. Thus, the 
interactive advertisement itself can be seed or heard and 
operated any time the user likes. 

In the present embodiment, there has been described 
a case in which a spot advertisement is displayed immediately 
after the power switch has been turned ON and before ending 
applications A, B, C ... , and going to the menu screen. This 
advertisement may be inserted as an advertisement providing 
frame into the applications A, B, C, without being limited 
thereto. At this time, the spot advertisements are provided 
so as to be incorporated individually in each of the 
applications based on additional definition processing. 

(4) Third Embodiment 

FIG. 14 is a block diagram depicting an exemplary 
internal configuration and connection of a tuner device 24' 
and a hand held terminal device 14 used in an interactive 
advertisement system 300 that is a third embodiment 
according to the present invention. 

In this example, a data received by the tuner device 24' is 
directly transferred to and stored in the data storage 75 in the 



74 



hand held terminal device 14 or a non-volatile storage device 
such as external flash memory 43. Like elements in the 
second embodiment are designated by like reference numerals 
and names, a description of which is omitted here because 
these functions are similar to each other. 

In this interactive advertisement system 300, unlike 
the second embodiment, a non-volatile storage device is not 
provided in the tuner device 24 r . In the case where a digital 
program broadcast and an interactive advertisement are 
received from the broadcast station 9, they are always received 
in a state in which the hand held terminal device 14 is 
mounted on the tuner device 24'. 

In an operation during reception, at the step C6 in the 
flow chart shown in FIG. 11, as described in the second 
embodiment, a data is directly transferred to the hand held 
terminal device 14, and is subject to writing control of the 
microcomputer 70 in this hand held terminal device 14. 
Then, information concerning a data broadcasting program 
and an interactive advertisement is stored in the data storage 
75 or external flash memory 43 and the like. The other 
operation is identical to that in the second embodiment, a 
description of which is omitted here. 

Therefore, in the third embodiment, unlike the second 
embodiment, a flash memory 33 can be omitted from the tuner 
24', and the tuner device 24' can be reduced in price. 
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(5) Fourth Embodiment 

FIG. 15 is an imaginary view showing an exemplary 
configuration of an interactive advertisement system 400 that 
is a fourth embodiment according to the present invention. 
FIG. 16 is an imaginary view showing an exemplary format of a 
data in an advertisement specific channel. 

This interactive advertisement system 400 is directed 
to a system, in which there is provided a hand held terminal 
device 40 1 with a tuner function as shown in FIG. 15, provided 
as an example of an information processing apparatus, and 
advertisement information D2 concerning an interactive 
advertisement is directly received from the broadcast station 9 
or the like through a rod antenna 41 so as to be stored in a 
non-volatile memory. Of course, broadcast information 
contents Dl concerning a data broadcasting program may be 
downloaded. 

In particular, there is shown a case in which 
advertisement information D2 is distributed exclusively by 
using an advertisement specific channel. The advertisement 
specific channel used here denotes a channel for specially 
distributing only the advertisement information D2 
concerning an advertisement. After receipt of the 
advertisement information D2, in the hand held terminal 
device 401, the user can read out and freely operate 
advertisement information D2 concerning an interactive 
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advertisement from a flash memory in unreal time any time 
and any place the user likes. 

Of course, advertisement information D2 includes 
video image element and audio information D22 concerning an 
advertisement whose information can be operated by the user; 
and program information 21 for processing these items of 
information D22. In this example, in the advertisement 
specific channel, a plurality of advertisement information D2 
are distributed. In any of the items of advertisement 
information D2 downloaded from the advertisement specific 
channel a priority to display it many times prior to another 
advertisement video image is set in advance. 

In the advertisement specific channel, as shown in 
FIG. 16, all the data concerning a plurality of advertisements 
are broadcast one time, and the entire program is composed of 
a directory file and "n" commercials CM1 to CMn. Namely, 
the directory file is placed at the beginning of the program, 
and concerning an advertisement contained in this program, 
the number (n) of contents of commercials (CM); "n" items of 
CM directory information; CM counts, program size; on air 
codes that is a broadcast date and time; program codes and 
the like are described in a data packet. 

Following this directory file, the commercial data CMi 
(i = 1 to n) of each company is arranged sequentially. A file 
header is assigned to each of the commercial data CMi. At 
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the header, there are described advertisement information D2 
such as advertisement codes such as advertisement number; 
client codes for discriminating each advertiser 99; file size 
indicating data length; a variety of flags for formating and 
controlling data or the like. The CM data following these 
items of information contains program information D2 1 + 
video image element and audio information D22, like game 
software. The contents of these items of information are as 
described with reference to Fig. 7. 

Now, an exemplary internal configuration of a hand 
held terminal device 401 with a tuner device will be described 
here. FIG. 17 is a block diagram depicting an exemplary 
internal configuration of the hand held terminal device 401. 
Like elements in the third embodiment are designated by line 
reference numerals and name, a description of which is 
omitted here because these functions are similar to that in 
third embodiment. In this example as well, in the case where 
a data is distributed by an existing broadcast infrastructure, 
the data multiplexed in a vertical blanking period of a data 
broadcast signal adopted by the broadcast infrastructure is 
received in the tuner 55, and the data is provided so as to be 
downloaded on the flash memory 33. 

The hand held terminal device 40 shown in FIG. 17 
receives a group of data sent from the broadcast station 9, and 
causes image processing, and has a system bus 79. To this 
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system bus 79, there are connected a receiver 2, a control 
device 3, an operating unit including user interface 4 and 
operation key 32, a display unit 6, and an audio processing 
unit 7 or the like. These receiver 2, processing unit 3 and 7, 
operating unit and display unit 6 are driven by means of a 
secondary battery 87. 

The receiver 2 has a tuner 55, a communication 
modem 22, a channel selection switch 38, a channel selection 
circuit 56 and a flash memory 33. This receiver receives a 
group of data by means of the tuner 55 or communication 
modem 22. Then, data such as broadcast information 
contents Dl after decoded, program information D21, or video 
image element and audio information D22 is stored in the 
flash memory 33, 

This communication modem 22 is connected to 
Internet, telephone line, or satellite line and the like so that a 
group of data received by these communication lines are 
temporarily stored in the flash memory. The communication 
modem 22 is used as a telephone function for transmitting and 
receiving an audio between a local station and a remote 
station. In the case where a simple hand held terminal 
device such as hand held radio, having only a tuner function, 
is configured, the communication modem 22 may be omitted. 
In contrast, in the case where a hand held terminal device 
having a telephone function is configured, it is mandatory that 
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the communication modem 22 is provided. 

The control device 3 in this example has a data 
decoding circuit 58 and a microcomputer 90 in which the video 
image element and audio information D22 is arbitrarily video 
imaged and processed based on the program information D21 
stored in the flash memory 33 and operation input D3 passed 
through the user interface 4 so as to reproduce the 
advertisement video image and its audio. Of course, a data 
broadcasting program may be reproduced based on the 
broadcast information contents Dl. 

The user interface 4 configuring the operating unit is 
connected to this system bus 79, and an operation key 32 is 
connected to this interface 86. The operation key 32 is 
operated to control the data decoding circuit 58 and the 
microcomputer 90. 

Further, a liquid crystal display controller (LCDC) 88 
configuring a display unit 6 is connected to the system bus 79, 
and a liquid crystal display monitor 122 is connected to this 
controller 88 so as to display an interactive advertisement 
video image operated by the operation key 32. The audio 
processing unit 7 reproduces audio information according to 
an interactive advertisement, and performs amplification. 
Then, an audio signal is output to the speaker 77. In the 
case of the audio processing unit with a hand held telephone 
function, it functions as a telephone receiver. A microphone 
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78 is connected to this audio processing unit 7. In the case 
of the audio processing unit with the hand held telephone 
function, it functions as a transmitter. 

Now, an exemplary operation of a hand held terminal 
device 401 with its tuner function will be described here. FIG. 
18 is a flow chart showing an example of data processing when 
the user sees and hears an advertisement specific channel of 
the hand held terminal device 401. 

The present embodiment assumes a case in which an 
advertisement specific channel is selected by using an existing 
terrestrial broadcasting infrastructure, and data concerning 
an interactive advertisement are distributed from the 
broadcast station 9 to the hand held terminal device 401. 
There is exemplified a case in which at the transmission side, 
as electronic information contents DO concerning an 
advertisement, there is provided, for example, advertisement 
information D2 consisting of n commercial data CMi (i = 1 to n) 
concerning vehicle sale, real estate sale, cosmetic sale, game 
software sale, or the like, and these data D2 = CMI + CM2 + 
CM3 ... CMn are transmitted by using a vertical blanking 
period of a TV broadcast signal. A priority is set to 
commercial data CMi. The information concerning this 
priority can be described in the directory file or file header 
shown in FIG. 16, for example. 

For example, the priority of commercial contents can 



81 



be changed day by day. This change is made in order to 
improve an advertisement effect. This example assumes a 
case in which a priority is highly set to commercial data CM8 
of the broadcast date. The advertisement caused by 
commercial data CM8 to which a high priority is set is referred 
to as prime CM hereinafter. This prime CM video image is 
defined as commercial contents with their guaranteed 
exposure frequency, and of course, an advertisement fee is 
high. This prime CM video image is always organized to 
appear on a screen when power is turned ON and OFF in many 
CM program groups CMi (i = 1 to n) configured by being 
downloaded once. 

In this case, the liquid crystal display monitor 122 is 
provided so as to first display a prime CM video image caused 
by commercial data CM8 before displaying an advertisement 
video image (hereinafter, referred to as a second CM) caused 
by commercial data CMI to CM7 and CM9 to CMn to which no 
priority is set. In addition, the prime CM video image is 
displayed again after the display of the second CM video image 
has been ended. 

When a prime CM is further displayed, a control program is 
executed such that the user can select arbitrary commercial 
data CMi from among the remaining commercial data CM 1 to 
CM7 and CM9 to CMn. Namely, another CM group is 
executed by being selected on a menu screen so that the user 
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Hj starts up and operates a CM program like playing a mini 
game. 

This example assumes a case in which a flash memory 
43 stores in advance advertisement information D2 = CM1 + 
CM2 + CM3 ... CMn that consists of "n" commercial data CMi (i 
= 1 to n) concerning vehicle sale, real estate sale, cosmetics 
sale, or game software sale or the like; and the hand held 
terminal device 401 enters a standby mode. 

With this being presumed, when power is turned ON 
at the step Gl in the flow chart shown in FIG. 18, a standby 
mode is released, and the hand held terminal device 401 goes 
to a normal mode. Then, processing goes to the step G2 at 
which a prime CM video image is displayed on the liquid 
crystal display monitor 122. At this time, the program 
information D21 according to the prime CM and the video 
image element and audio information D22 are read out from 
the flash memory 33 to the microcomputer 90. Then, the 
display unit 6 or audio processing unit 7 and the like is 
controlled by means of the microcomputer 90, whereby a 
three-dimensional, high resolution prime CM video image and 
its audio are reproduced. 

At this time as well, as described in the second 
embodiment, the operation key 32 is operated with respect to 
the prime CM, whereby the video image element and audio 
information D22 can be video imaged and processed based on 
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the program information D21 as described in FIG. 13, and a 
two-dimensional or three-dimensional video image of an 
interactive advertisement can be played like playing a game. 

Then, processing goes to the step G3 at which it is 
judged whether or not the interactive advertisement operating 
mode is ended. This judgment is entrusted to the user Hj. 
In the case where the interactive advertisement operating 
mode is not ended at the step G3, processing goes to the step 
G4 at which a menu screen is displayed. The menu selection 
screen displays commercial data CMi (i = 1 to 7, 9 to n) 
according to "n - 1" second CMs such as vehicle sale, real 
estate sale, cosmetics sale or the like other than commercial 
data CM8 according to the prime CM. Of course, at this time, 
the commercial data CM8 according to the prime CM may also 
be displayed. 

Then, processing goes to the step G5 at which the 
microcomputer 90 waits until the commercial data CMi 
according to the second CM has been selected. Here, the 
user Hj selects an arbitrary second CM from among "n" second 
CMs. In the microcomputer 90, the commercial data CMi 
selected by the user Hj is read out from the flash memory 33. 

Then, processing goes to the step G7 at which 
application processing of commercial data CMi is executed in 
the microcomputer 90. At this time as well, the program 
information D21 according to the second CM and the video 
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image element and audio information D22 are read out from 
the flash memory 33 to the microcomputer 90. Then, the 
display unit 6 or audio processing unit 7 and the like is 
controlled by means of the microcomputer 90, whereby a 
three-dimensional and high resolution second CM video image 
and its audio is reproduced. 

At this time, as described in the second embodiment, 
the operation key 32 is operated with respect to the second CM, 
whereby the video image element and audio information D22 
can be video imaged and processed based on the program 
information D21 as described in FIG. 13, and a two- 
dimensional or three-dimensional video image of an 
interactive advertisement can be played like playing a game. 

Then, processing goes to the step G8 at which it is 
judged whether or not the application processing is ended. 
This judgment is also made by the user Hj. In the case where 
the application processing is ended, processing reverts to the 
step G2 at which a prime CM video image is displayed. In the 
case where the application processing is not ended, processing 
goes to the step G9 at which it is judged whether or not the 
application processing is repeatedly executed. 

This judgment is also made by the user Hj. In the 
case where the application processing is repeatedly executed, 
processing reverts to the step G7 at which application 
processing of commercial data CMi is repeatedly executed. 
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In the case where the application processing is not repeatedly 
executed at the step G9, processing reverts to the step G4 at 
which a menu screen is displayed again. On this menu 
screen, there are provided a variety of selection modes in 
which advertisement objects are classified by categories such 
as software, commodity, company or randomly (in a shuffling 
manner) or by user's characteristic dependency and the like. 

Application processing selected on the menu screen is 
executed. When the application processing is then ended at 
the step G8, processing reverts to the step G2 at which a prime 
CM video image is displayed again. In the case where the 
interactive advertisement operating mode is ended, processing 
goes to the step G10 in accordance with a command issued by 
the user Hj to end the microcomputer 90 at the step G3. 
Then, the liquid crystal display monitor 122 is set to a clock 
screen, the microcomputer 90 detects power OFF information, 
and enters a standby mode. 

In this way, in an interactive advertisement system 
400 that is a fourth embodiment according to the present 
invention, the video image element and audio information D22 
concerning a plurality of advertisements whose information 
can be operated by the user Hj and the program information 
D21 for processing these items of information D22 are 
provided to be distributed by using an advertisement specific 
channel. 
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Therefore, an advertisement video image can be 
operated at the user side like playing a game. Thus, in the 
future, electronic information contents DO concerning an 
advertisement can be expected to naturally spread in an 
increased number of users Hj who likes to play a game. This 
makes it possible to contribute to the introduction into a new 
demand for advertisement industry. 

Moreover, as in the second embodiment, unlike an 
advertisement of a conventional television or radio broadcast, 
the advertisement information D2 temporarily stored in the 
flash memory 33 of the hand held terminal device 401 is used, 
and the user can see or hear and operate an interactive 
advertisement itself any time he or she likes. 

In the fourth embodiment, the microcomputers 70 and 
90 or interfaces 60 and 70 can be integrated with each other in 
comparison with a case in which the hand held terminal device 
14 and the tuner device 24 are created separately as in the 
second embodiment. Thus, in comparison with a case in 
which the hand held terminal device 14 and the tuner device 
24 are provided separately, thereby constructing an 
interactive advertisement system, the hand held terminal 
device 401 with its tuner function is provided, thereby making 
it possible to reduce the cost of an information processing 
apparatus applied in the interactive advertisement system 400 
and to simplify the system. 
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As has been described above, an electronic 
information content distribution processing system according 
to the present invention comprises an information processing 
apparatus for information processing electronic information 
contents containing an advertisement, wherein electronic 
information contents are received and stored; the electronic 
information contents are read out according to a user 
operation; the electronic information contents are processed; 
and then, an advertisement video image and audio information 
is output. 

With this configuration, a concept of an advertisement 
caused, the advertisement having been supplied one-sidedly, 
is reversed, and an electronic advertisement medium for 
interactively performing an advertisement can be constructed. 
Moreover, the user can operates an advertisement information 
medium freely while feeling more enjoyable relevant to an 
advertisement that has been just seen and heard. Thus, the 
user's interest is improved, and an advertiser can implement 
an advertisement with its long advertisement life and high 
advertisement effect. 

An information distribution apparatus according to 
the present invention comprises a transmitter for, in the case 
where electronic information contents containing an 
advertisement are provided to the user, transmitting to the 
user's information processing apparatus a carrying signal in 
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which a group of data relevant to electronic information 
contents concerning an advertisement is constructed and 
inserted. 

With this configuration, in the user's information 
processing apparatus, a group of data can be received in batch 
in a predetermined period of time, and can be stored in a 
storage device or the like all together. Therefore, after 
receipt of electronic information contents, the user can see 
and hear an advertisement video image or audio information 
freely processed with respect to an advertisement by the 
information processing apparatus in unreal time 
(asynchronously) . 

In an information processing apparatus according to 
the present invention, in the case where electronic 
information contents containing an advertisement are 
information processed, the electronic information contents are 
received and stored, the electronic information contents are 
read out according to the user operation, the electronic 
information contents are processed, and then, an audio 
advertisement video image and audio information is output. 

With this configuration, after receipt of electronic 
information contents, the user can see and hear freely the 
advertisement video image and audio information obtained 
after arbitrarily information processed like playing a game in 
unreal time. In this manner, a new game medium following 
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arcade game, home use game machine, or hand held game 
machine can be created. A new medium fusing the 
entertainment device and advertisement can be created. 

In an electronic information content distribution 
processing method according to the present invention, in the 
case where electronic information contents containing an 
advertisement are provided to the user, and the electronic 
information contents are information processed at the user 
side, the electronic information contents are distributed to the 
user, and the thus distributed electronic information contents 
are received and stored. Then, electronic information 
contents are read out according to the user operation so as to 
reproduce an advertisement video image and audio 
information based on the electronic information contents. 

With this configuration, the user can operate 
electronic information contents like playing a game. In the 
future, the electronic information contents concerning an 
advertisement can be expected to naturally spread in an 
increased number of users who likes to play a game. 
Therefore, an advertisement effect can be improved, making it 
possible to introduce a demand for a new advertisement 
industry. Instead of a commodity guidance that has been 
supplied one-sidedly, the commodity is expressed with a 
variety of angles and colors, whereby the user can have an 
image as if the commodity were touched in hands. As a result, 
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more detailed commodity recognition can be imparted to the 
user, making it possible to bring a chance in which the user 
can be familiar with commodities on a video image space. 

In addition, a conventional advertisement production 
has been dominant in cumbersome and costly work such that 
talents or new products are defined as main items, thereby 
causing performance or photographing activities. According 
to the method of the present invention, work concerning 
advertisement production can be digitally processed. In 
addition, a demand for digital creators engaged in animation, 
game software, or cinema production is increased, making it 
possible to cause creation of new employment and 
introduction into new industry. Further, exchange between 
a company that is an advertiser and a CM production creator 
is made actively, and the development and spread of computer 
graphic technology can be accelerated. 

The present invention is applied very preferably to a 
new advertisement medium such that the user operates 
advertisement contents distributed via broadcast or 
communication interactively and feels more enjoyable like 
playing a game. 
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